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(54) IMAGE CODING DEVICE AND IMAGE DECODING DEVICE 

(57) If coding is carried out on the block basis on 
subband coding of an image, the hierarchical character- 
istic which a subband image inherently has would be 
lost. Thus, efficient coding is to be carried out while 
holding the hierarchical characteristic of the subband 
image. After the subband image is coded on the block 
basis, symbol information and coefficient information 
are decomposed and relocated for every subband 
before producing coded data. 
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Description 



Field of the Invention 



5 [0001] The present invention relates to a digital image processing technology, and in particular to an image coding 
device for coding image data with a high efficiency and an image decoding device for decoding the coded data which 
has been coded by the image coding device. 

Background Art 

10 

[0002] Recently, subband coding techniques have been proposed as highly efficient image coding and decoding tech- 
niques. Among the subband coding techniques, a technique for decomposing an image into bands as shown in Fig. 16 
in which analysis of an input image is carried out by means of a band decomposing filter bank has been generally 
known as a technique having a high coding efficiency. Such a technique is described by, for example, Fujii and Nomura 
is "Topics on Wavelet Transform", technical report. IEICE, Institute of Electronics, Information and Communication Engi- 
neers, IE 92-11 (1992). 

[0003] Fig. 1 6 shows subband images which are obtained by conducting two dimensional subband decomposition for 
an input signal three times. A horizontal high frequency and vertical low frequency subband which is obtained by the 
first decomposition is designated as HL1. A horizontal low frequency and vertical high frequency subband is designated 
20 as LH1. A horizontal high frequency and vertical high frequency subband is designated as HH1. Subbands HL2, LH2 
and HH2 are obtained as similarly to the foregoing by conducting second two-dimensional subband decomposition for 
the horizontal low frequency and vertical low frequency subband. 

[0004] Subband HL3, LH3 and HH3 are obtained similarly to the foregoing by conducting third two-dimensional sub- 
band decomposition for the horizontal low frequency and vertical low frequency subband which has been obtained by 
25 second decomposition. A horizontal low frequency and vertical low frequency subband at this time is designated as 
LL3. The filter bank which is used for decomposing band may use a filter bank for wavelet transformation and a subband 
decomposing synthesizing filter bank and the like. The image which has been decomposed into subbands in such a 
manner has a hierarchical structure. 

[0005] As a recent technique having the highest coding efficiency which is capable of adapting to the subband 
30 images, a ZTE (Zero Tree Entropy coding) technique using the above-mentioned hierarchical structure has been pro- 
posed (ISO/IEC JTC/SC29/WG11/MPEG95/N0441.ISO/IEC JTC1/SC29/WG1 1/MPEG96/ M0637 , ISO/IEC 
JTC1/SC29/WG1 1 /MPEG96/M1 539). 

[0006] Now, the ZTE technique will be described. In the ZTE technique, a block structure which is shown in Fig. 18 is 
formed by collecting subband coefficients (hereinafter referred to as coefficients) corresponding to the same spacial 
35 positions which are linked with each other by arrows as shown in Fig. 17 from the image which has been decomposed 
in subbands. It has already known that there is a correlation between coefficients which are linked with each other by 
arrows in Fig. 1 7 excepting the highest frequency subbands. 

[0007] The whole relation of the coefficients which are linked with each other by arrows in Fig. 17 is referred to as 
"trees". One coefficient of each of the subbands (LH3, HL3, HH3) having a frequency one level higher than that of one 

40 coefficient of the lowest frequency subband (LL3) corresponds thereto (for example, a1 , a2 and a3 correspond to aO in 
Fig. 17). Four coefficients of each of the subbands (LH2, HL2, HH2) having a frequency one level higher than that of 
each of these coefficients correspond thereto (for example, a 10, a11, a12, a13 correspond to a1 in Fig. 17). Sixteen 
coefficients of each of the subbands (LH1 , HL1 , HH1 ) having a frequency one level higher than that of each of four coef- 
ficients correspond thereto. Trees with respect to coefficient aO is shown in Fig. 19. White circle O and so,,d black circle 

45 • in Fig. 1 9 denote coefficients in each subband. The trees in upper area comprise coefficients of the subbands having 
a lower resolution while the trees in lower area comprise coefficients of the subbands having a higher resolution. 
[0008] In such a tree structure, the coefficients having lower resolution are referred to as "parents" and the coefficients 
having next higher resolution in the same spacial position as designated by arrows are referred to as "children", in Fig. 
19, for example, coefficient aO is a parent for coefficients a1 , a2 and a3, which are in turn children for coefficient aO. 

so Coefficient a1 is a parent for coefficients a1 0, a1 1 , a1 2 and a1 3 and, coefficients a1 0, a1 1 , a1 2 and a 1 3 are children 
for coefficient a1. 

[0009] All coefficients having higher resolution in the same spacial position which are linked with each other by arrows 
with respect to one parent are referred to as "descendants" and all coefficients having a lower resolution in the same 
spacial position which are linked with each other by arrows with respect to one child are referred to as "ancestors". In 
55 Fig. 19, for example, the coefficients encircled with a dotted line are descendants for coefficient a1 and coefficients a10, 
a1 and aO are ancestors for coefficient al 00. 

[001 0] Then, the coefficients are quantized in the block basis. Three symbols are assigned to each node of the trees 
for representing whether the quantization coefficient is zero or non-zero. Definition of the symbol will now be described. 
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The coefficient having the lowest frequency among the coefficients in which one coefficient in a tree is zero and the 
coefficients of its descendants are all zero is referred to as zero-tree-root (ZTR), Since this coefficient and the coeffi- 
cients having a higher resolution than that of the former coefficient are all zero at this time, it would be unnecessary to 
code the coefficients of its descendant if ZTR appear an a tree. When any one coefficient in a tree is not zero, but the 

5 coefficients of its descendant are all zero, the coefficient in interest is referred to as valued zero-tree root (VZTR). If 
there is any one non-zero coefficient in the descendant, its coefficient is referred to as "Value". 
[001 1 ] White and solid black circles denote the coefficients which the quantizing value is zero and non-zero, respec- 
tively in Fig. 19. In this case, the coefficients which require coding are shown in Fig. 20. Since aO has a quantizing value 
which is not "zero" in Fig. 20, the symbol Value is assigned to code the quantizing value. Since al and its descendants 

10 (a10 through a13, a100 through a103 through a133) are all zero, symbol ZTR is assigned to a1 and it is not necessary 
to code the quantizing value. Since it can be found that the value of al is zero due to the fact that a1 is ZTR, H is never 
necessary to code the information on the descendants of a1 . 

[001 2] Since a2 has a quantizing value which is not zero, but its descendants all have a quantizing value which is zero, 
symbol VZTR is assigned for coding only the quantizing value of a2. Concerning the descendants of a2, same as those 
is of al , it is not necessary to code their information. Since a3 has a quantizing value which is not zero and there are some 
descendants which have a quantizing value which is not zero, symbol Value is assigned for coding the quantizing value. 
VZTR is assigned for a30. ZTR is assigned for a31 . Value is assigned for a32 and a33. Only the quantizing values of 
the coefficients having the highest frequency (a320 through a333) are coded without assigning a symbol to the coeffi- 
cients, As mentioned above, the information to be coded on this block comprises: 

20 

symbol information including Value, ZTR, VZTR, Value, VZTR, ZTR, Value, Value, Value, Value, Value Value 

and 

coefficient information including Q (aO), Q(a2), Q(a3), Q(a30), Q(a32), Q(a33), Q(a320), Q(a321), Q(a322) 

Q(a333), wherein Q(a) denotes the quantizing value of the coefficient a. The contents of coded data are shown in 
25 Fig. 21. 

[0013] When the symbol is VZTR or Value, it is necessary to code the quantizing values of the coefficients. Since 
there are generally a lot of coefficients having a quantizing value which is zero in the high frequency subband, many 
ZTRs are generated so that it is unnecessary to code the coefficient value. Therefore high coding efficiency is achieved. 
30 [0014] As mentioned above, in the ZTE technique the order of coding of the coefficients does not shift subband by 
subband, but quantization of each block is conducted, then the symbol information and the coefficient information in the 
block basis is completely coded and thereafter coding of next block is initiated. 

[001 5] An image coding device using the ZTE technique is shown in Fig. 1 4 and an image decoding device using the 
ZTE technique is shown in Fig. 15. In Fig. 14, a reference numeral 1401 denotes a subband decomposing portion for 

35 decomposing an image into subbands by means of a two-dimensional decomposing filter, 1 402 denotes a block forming 
portion for forming a block by collecting coefficients having a parent-child relationship from the decomposed subbands 
as shown in Fig. 18, 1403 denotes a quantizing portion for quantizing the coefficients in the block basis, 1404 denotes 
a symbol information determining portion for determining the symbol which is shown in Fig. 20 in the block basis from 
the coefficients after the quantization, 1405 denotes a symbol information coding portion for variable-length coding 

40 each symbol information, 1 406 denotes a coefficient coding portion for coding only the coefficients in which the symbol 
information which is determined in portion 1404 corresponds to VZTR or Value, and 1407 denotes a data integrating 
portion for integrating to array the symbol information before the coefficient information in one block. Fig. 22 is a flow 
chart showing a series of the operations. 

[0016] In Fig. 15, a reference numeral 1501 denotes a data separating portion for separating coded data into symbol 
45 information and coefficient information for each one, 1 502 denotes a symbol information decoding portion for variable- 
length decoding symbol information, 1503 denotes a coefficient decoding portion for decoding the coefficients corre- 
sponding to Value and VZTR based upon the decoded symbol information, 1 504 denotes a block data reproducing por- 
tion for reproducing all coefficient values for one block based upon the decoded symbol information and coefficient 
information, 1505 denotes an inverse quantizing portion for inverse quantizing the quantized coefficients for each block, 
so 1506 denotes a subband image producing portion for producing the whole subband image by relocating the coefficient 
values of all blocks to deblocking them, and 1507 denotes a subband synthesizing portion for performing a subband 
synthesis by means of a two-dimensional synthesizing filter. Fig. 23 is a f low chart showing a series of operations. 
[0017] The subband coefficients can be efficiently coded and decoded in the block basis by using the above-men- 
tioned image coding and decoding devices. 
55 [0018] Since a block in which subband coefficients having a parent-child relationship are collected is formed and 
coded in the ZTE technique in such a manner, quantization in the block basis is possible. The coding efficiency can be 
improved by using a fact that most of the coefficients of the high frequency are zero. On the contrary, the coded data 
can not be provided with the scalability which the subband coding inherently possesses. 
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[0019] In other words, reproduced images having different resolutions can be decoded from part of the coded data 
as shown in Fig. 24 in the conventional subband coding technique in which information on one subband is coded and 
then the information on the subband having the next higher resolution is coded. If for example, the information on only 
LL3 is decoded from the coded data, the whole image could be reproduced at the lowest resolution. 
5 [0020] If LL3, HL3, LH3 and HH3 among the coded data are decoded, the whole image can be reproduced at a res- 
olution which is higher than the case of decoding of only LL3. If all coded data is decoded, the whole image can be 
reproduced at the highest resolution. 

[0021] However, in the ZTR technique, quantization in the block basis is possible and the coding efficiency can be 
improved by using the fact that most of the coefficients of the high frequency subband is zero. But if some of the coded 
10 data is decoded from the left and upper area of an image in the block basis, only part of the image can be reproduced 
although the regenerated part has a high resolution. In other words, the scalability which the subband inherently has is 
lost in the ZTE technique. 

Disclosure of the Invention 

15 

[0022] In order to overcome the above-mentioned problems, 

(1) The present invention provides an image coding device comprising means for decomposing an image into sub- 
bands to produce a first subband image; means for forming a blocked second subband image by collecting sub- 

20 band coefficients having a parent-child relationship between subbands in said first subband image to form a 
plurality of blocks; means for quantizing said subband coefficients of each block of said second subband image; 
means for determining symbol information representing whether the quantized subband coefficient of said second 
subband image is "0" or non "0"; means for relocating the symbol information of said second subband image in 
accordance with the frequency position in said first subband image; means for variable-length coding said relo- 

25 cated symbol information; means for relocating said quantized subband coefficients to be coded based upon said 
symbol information and forming a third subband image in accordance with the frequency position in said first sub- 
band image; means for variable-length coding said relocated subband coefficients; and means for collecting and 
arranging said coded symbol information and subband coefficients in each subband. 

(2) The present invention comprises: means for separating said coded data into symbol information and subband 
30 coefficients; means for decoding said coded symbol information for each subband; means for reproducing said 

third subband image by decoding each of said subband coefficient based upon said decoded symbol information; 
means for forming said second blocked subband image comprising a plurality of blocks which are formed by col- 
lecting said decoded subband coefficients having a parent-child relationship in each subband; means for inverse 
quantizing said decoded subband coefficients of said second subband image; means for producing subband 
35 images which are relocated in accordance with the frequency position in said third subband coefficient by deblock- 
ing said inverse quantized subband coefficients of said second subband image; and means for synthesizing said 
subband images to provide a decoded image. 

(3) There is provided means for arranging firstly all pieces of said symbol information in each subband and then 
arranging all said subband coefficients in each subband when said coded symbol information and subband coeffi- 

40 cients are collected into one group for each subband. 

(4) There is provided means for conducting an operation for separating the coded data which is one group compris- 
ing the symbol information and subband coefficients which are collected for each subband into all pieces of said 
symbol information in one subband firstly, and then into all said subband coefficient information in one subband. 

(5) There is provided means for arranging sets of said symbol information and said subband coefficient correspond- 
45 ing thereto in accordance with the order of said symbol information in each subband, when said coded symbol 

information and subband coefficients are collected into one group for each subband. 

(6) There is provided means for conducting an operation for separating the coded data which is one group compris- 
ing the symbol information and subband coefficients which are collected for each subband into said symbol infor- 
mation and said subband coefficient for each symbol for all subbands in said coded data. 

50 (7) in lieu of said symbol information coding portion, said coefficient information coding portion and said coded data 
integrating portion, there are provided means fa forming a set of the symbol information and subband coefficient 
corresponding to said symbol information, and means for variable-length coding said set of said symbol information 
and subband coefficient information. 

(8) In lieu of said decoded data separating portion, said symbol information decoding portion and said coefficient 
55 information decoding portion, there are provided means for decoding a set of said symbol information and subband 

coefficient information and means for separating said decoded set into symbol information and coefficient informa- 
tion. 

(9) There is provided means for inserting "0" into the subband coefficient value which can not be decoded if com- 
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plete coded data which is produced by said image coding device can not be inputted. 
Brief Description of Drawing 
s [0023] 

Fig. 1 is a block diagram showing an embodiment of the invention. 

Fig. 2 is a block diagram showing an embodiment of the invention. 

Fig. 3 is a diagram explaining the present invention. 
10 Fig. 4 is a diagram explaining the present invention. 

Fig. 5 is a diagram explaining the present invention. 

Fig. 6 is a flow chart explaining the operation of the present invention. 

Fig. 7 is a flow chart explaining the operation of the present invention. 

Fig. 8 is a block diagram showing an embodiment of the present invention. 
is Fig. 9 is a flow chart explaining the operation of the present invention. 

Fig. 1 0 is a block diagram showing an embodiment of the present invention. 

Fig. 1 1 is a block diagram showing an embodiment of the present invention. 

Fig. 1 2 is a flow chart explaining the operation of the present invention. 

Fig. 13 is a flow chart explaining the operation of the present invention. 
20 Fig. 1 4 is a block diagram showing the prior art. 

Fig. 1 5 is a block diagram showing the prior art. 

Fig. 16 is a diagram explaining the prior art. 

Fig. 17 is a diagram explaining the prior art. 

Fig. 18 is a diagram explaining the prior art. 
25 Fig. 1 9 is a diagram explaining the prior art. 

Fig. 20 is a diagram explaining the prior art 

Fig. 21 is a diagram explaining the prior art. 

Fig. 22 is a flow chart explaining the operation of the prior art 

Fig. 23 is a flow chart explaining the operation of the prior art. 
30 Fig. 24 is a diagram showing the scalability of the subband decomposition. 

Fig. 25 is a diagram explaining the problems of the prior art. 

Best Modes for Embodying the Present Invention 

35 [0024] Now, embodiments of an image coding device and image decoding device of the present invention will be 
described in detail with reference to the drawings. 

[0025] Fig. 1 is a block diagram showing a first embodiment of the coding device of the present invention, in the draw- 
ing, a reference numeral 101 denotes a subband decomposing portion, 102 denotes a block forming portion, 103 
denotes a quantizing portion, 1 04 denotes a symbol information determining portion, 1 05 denotes a symbol information 

40 coding portion, 1 06 denotes a coefficient coding portion. These portions 1 01 , 1 02, 1 03, 1 04, 1 05 and 1 06 are identical 
in structure with those 1401, 1402, 1403, 1404, 1405 and 1406, respectively, which are shown in Fig. 14. 
[0026] In other words, by means of the subband decomposing portion 1 01 , block forming portion 1 02, quantizing por- 
tion 1 03 and the symbol determining portion 1 04, an image is decomposed into subbands, which are divided into blocks 
as shown in Fig. 1 8. Then, the subband coefficients are quantized for each block. This operation is similar to that of the 

45 prior art Quantization is conducted in the block basis although all blocks may be quantized in the same quantization 
stepsize in a special case. In the present embodiment the symbols and the quantization coefficients in Fig. 18 which 
are produced by the prior art are divided and relocated in each subband so that subband images are produced again. 
And coding of the symbol information and coefficient information is conducted in order from the subband having a lower 
resolution. 

so [0027] A reference numeral 1 08 in Fig. 1 denotes the symbol information relocating portion which relocates the sym- 
bol information which is prepared for each block by the prior art for each subband. One block of the blocked subband 
image which is produced by the prior art in Fig. 18 corresponds to the block in a part (a) of Fig. 3. The portion 108 in 
Fig. 1 conducts the relocation of the symbol from the part (a) to a part (b) of Fig. 3 for each block for producing a new 
subband image to output it to the memory 110. 

55 [0028] Since no symbol exists with respect to the coefficients of the descendants of ZTR and VZTR, a symbol "SKIP" 
is written into the memory 1 1 0 and the symbol information of SKIP is not coded when coding is conducted. The hatched 
areas denote SKIP in Fig. 3. As mentioned in the description of the prior art, where there is no symbol information in 
the subband having a highest frequency in the part (b) of Fig. 3. 
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[0029] A reference numeral 109 in Fig. 1 denotes a coefficient relocating portion which relocates the coefficient infor- 
mation which is quantized for each block by the prior art for each subband. One block of the blocked subband image 
which is produced by the prior art in Fig. 1 8 corresponds to the block in the part (a) of Fig. 3. The portion 109 in Fig. 1 
conducts the relocation of the coefficient information from the part (a) to a part (c) of Fig. 3 for each block for producing 
5 a new subband image to output it to the memory 111. However, in relation with the coefficients corresponding to SKIP 
stored in the memory 110, the symbol of the SKIP is written in iieu of the coefficient value as mentioned above and is 
not coded when coding is conducted. 

10030] Relocation of the symbols from the part (a) to (b) of Rg. 3 and the relocation of the coefficient values from the 
part (a) to (c) of Rg. 3 may be conducted by overwriting the relocated symbols and coefficient values into a memory in 
10 which the symbols and coefficient values are collected for each block which is shown in Rg. 18 without using the mem- 
ories 1 1 0 and 1 1 1 in Rg. 1 and by conducting the subsequent processing by the operation of addresses corresponding 
to the predetermined positions in memories 1 10 and 111. 

[0031] For simplicity of the description, the present embodiment will be described with reference to only the case in 
which the symbols and coefficient values are written into the memories 1 1 0 and 1 1 1 . Similar processing can be con- 
is ducted by performing an address calculation in Fig. 18 to reach the block corresponding to the above-mentioned mem- 
ories 110 and 111. 

[0032] A reference numeral 1 07 in Rg. 1 denotes the coded data integrating portion for collectively arranging the sym- 
bol information and coefficient information for each subband, which is stored in the memories 1 10 and 111. The method 
of integrating the symbol information and coefficient information includes two methods which are shown in a part (a) 
20 and (b) of Fig. 4. The part (a) of Rg. 4 shows an example of contents of the coded data when the symbol information 
and the coefficient information is collectively arranged for each subband. 

[0033] In the coded data integrating portion, the symbol information and coefficient information is consecutively input 
starting from that in the subband having the lowest frequency to the subband having higher frequency. After the symbol 
information of one subband is written into the coded data, the coefficient information of one subband is written into the 
25 coded data. Then the syrrbol information of one subband having a frequency which is higher by one level is written into 
the coded data. Such an operation is repeated until the subband having the highest frequency. The part (b) of Rg. 4 
shows another example of the contents of the coded data when the symbol information and coefficient information is 
collectively arranged for each subband. 

[0034] In the coded data integrating portion, firstly one set of the symbol information corresponding to one coefficient 
30 and one-coefficient information corresponding to this symbol information is written into the coded data and then simi- 
larly one set of symbol information of one coefficient and the coding information corresponding thereto is written into 
the coded data. This operation is repeated until the subband having the highest frequency. Since there is no coefficient 
information for the coefficients corresponding to ZTR and SKIP at this time, there is no input so that symbol information 
is successively input. Since no symbol information exists for the subbands having the highest frequency (HL1, LH1, 
35 HH1) as mentioned in the description of the prior art, only the coefficient information is coded. The coded data of the 
symbol information and coefficient information in the part (b) of Fig. 4 will be shown. S denotes symbol information and 
C denotes coefficient information. 



40 S,C,S,S,C,S,S,S,C,S,C,S,C,S,S,S,C,S.. - , c,c,c,c,c,c,c,c,c,c. 

*- subbands having frequency -+ *- subband having -* 

excepting the highest frequency the highest frequency 

45 



[0035] A part (a) of Fig. 6 is a flow chart showing one example of operation of the image coding device in Fig. 1 . A 
so part (b) of Rg. 6 is a flow chart for preparing coded data in the part (a) of Fig. 4. A part (c) of Fig. 6 is a flow chart for 
preparing coded data in the part (b) of Rg. 4. 

[0036] As mentioned above, scalability can be provided to the coded data by producing the coded data in order start- 
ing from the subband having lower resolution to the subband having higher solution by the relocation of the symbol 
information and coefficient information in the coding device in the first embodiment of the present invention. 
55 [0037] Now, the decoding device will be described. 

[0038] Rg. 2 shows a first embodiment of the decoding device of the present invention for decoding the coded data 
which is prepared by the coding device of the first embodiment of the present invention. Prior to the inverse quantization 
in the prior art which the coded data is decoded for reproducing the blocked subband images, which are inverse quan- 
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tized for each block, deblocked them to produce subband images, synthesized to provide a reproduced image, the sym- 
bol information and coefficient information is separated and decoded from the coded data and the decoded data is 
relocated for each subband for producing the whole of subband image and then an additional processing of blocking for 
inverse quantization is conducted. 

5 [0039] A reference numeral 201 in Fig. 2 denotes a coded data separating portion for separating the coded data into 
the symbol information and coefficient information to output the resultant information into the symbol information decod- 
ing portion 202 and the coefficient decoding portion 203. When the coded data of, for example the part (a) of Fig. 4 is 
input, a boundary between the coded symbol information of one subband and the coded coefficient information of one 
subband corresponding to the symbol information is detected and the symbol and coefficient information is output to 

10 the symbol information decoding portion and coefficient decoding portions, respectively. 

[0040] Such an operation is repeated for all subbands. When the coded data of, for example the part (b) of Fig. 4 is 
input, a boundary between the coded one symbol information and the coded coefficient information corresponding to 
the symbol information is detected and the symbol and coefficient information is output to the symbol information 
decoding portion and coefficient decoding portions, respectively. Such an operation is repeated for all subbands. How- 

15 ever, the symbol information is consecutively input since there is no relevant coefficient information when the symbol is 
ZTR. A reference numeral 208 denotes a memory for storing therein the symbol information which has been variable- 
length decoded by the symbol information decoding portion 202 to position corresponding to that on the subband 
images as shown in the part (b) of Fig. 3. 

[0041] Since no symbol having a parent-child relationship, which is higher in resolution exists when the symbol of a 
20 tree is ZTR or VZTR, SKIP is written in the memory 208 and no symbol is overwritten thereon similarly to the coding 
device. A reference numeral 209 denotes a memory for storing therein the coefficient information which has been var- 
iable-length decoded by the coefficient decoding portion 203 to position corresponding to that on the subband images 
as shown in the part (c) of Fig. 3. Since no coefficient having a parent-child relationship, which is higher in resolution 
exists when the symbol of the corresponding tree is ZTR or SKIP, "0" is written in the memory 209 and no coefficient 
25 value is overwritten thereon similarly to the coding device. 

[0042] However, the operation in the decoding device is different from that in the coding device only in that "0" is writ- 
ten in the memory in lieu of "SKIP" in the coding device. The coefficient having a parent-child relationship between the 
subbands are collected by the block forming portion 204 and based upon the coefficients stored in the memory 209 for 
forming blocks which are shown in the part (a) of Fig. 3. Thereafter, as mentioned in the description of the prior art, the 
30 quantized coefficients are inverse quantized for each block by the inverse quantizing portion 205 and the coefficient val- 
ues of all blocks are relocated by the subband image producing portion 206 for deblocking to produce the whole of the 
subband images. A reproduced image can be obtained by synthesizing the subbands by the subband synthesizing por- 
tion 207 using a two dimensional synthesizing filter. 

[0043] The symbol information decoding portion 202, coefficient decoding portion 203, inverse quantizing portion 
35 205, subband image producing portion 206, subband synthesizing portion 207 and the block forming portion 204 are 
identical in structure with the portions 1502, 1503, 1505, 1506, 1507 which are shown in Fig. 15 and the portion 104 
shown in Fig. 1 , respectively. A flow chart showing a series of operations is shown in Fig. 7. 
[0044] As mentioned above, the coded data having scalability can be decoded in the decoding device of the first 
embodiment of the present invention. 
40 [0045] Fig. 10 shows another example in which the coding device of the first embodiment of the present invention is 
implemented. The difference between the devices which are shown in Figs. 10 and 1 resides in that a set forming por- 
tion 1005 and a set coding portion 1006 are incorporated in lieu of the symbol information coding portion 105, coeffi- 
cient coding portion 106 and coded data integrating portion 107. Although the symbol information and the coefficient 
information is independently variable-length coded and arranged in the above-mentioned coding device of the first 
45 embodiment, the symbol information and coefficient information is variable-length coded after the set of the symbol and 
coefficient information in the present example has been formed. 

[0046] A set of one item of symbol information and coefficient information corresponding to this symbol information is 
prepared by the set forming portion 1005. Since no symbol information exist in the subbands having the highest fre- 
quency (HL1 , LH1, HH1), the coefficient information is treated one item by one item. If only symbol information exists 
so in the subbands having a frequency excepting the highest frequency and no corresponding coefficient information 
exists (ZTR), only symbol information is treated. Now, an example of sets of symbol information and coefficient infor- 
mation is shown. S denotes the symbol information, C denotes coefficient information, parentheses denote sets. 



55 
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[0047] The set coding portion 1006 is adapted to variable-length codes the sets of symbol information and coefficient 
information which are formed by the set forming portion 1005. The specific variable-length coding method may include 
two-dimensional Huffman coding of the symbol information and the coefficient information, variable-length coding in 

is which the same symbols are consecutive if only symbol information is consecutive and one-dimensional Huffman cod- 
ing if only coefficients are consecutive. A flow chart of a series of operations is shown in Fig. 12. 
[0048] As mentioned above, the symbol information and coefficient information are relocated in another coding device 
of the first embodiment of the present invention. Accordingly, it can be formed the coded data to have the scalability by 
forming from lower resolution subbands to higher resolution subbands in order. 

20 [0049] Fig. 1 1 shows another example in which the decoding device of the first embodiment of the present invention 
is implemented. 

[0050] The differences between the devices which are shown in Figs. 1 1 and 2 reside in that a set decoding portion 
1 1 01 and a set separating portion 1 1 02 are incorporated in lieu of the coded data separating portion 201 . the symbol 
information decoding portion 202, and coefficient decoding portion 203. Although the symbol information and the coef- 
25 ficient information which has been independently coded is variable-length coded after the separation thereof in the 
decoding device of the above-mentioned embodiment the set of the symbol information and coefficient information is 
variable-length coded and thereafter is separated into the symbol information and coefficient information in the present 
case. 

[0051] In the set decoding portion 1101, coded data in which the set of the symbol information and the coefficient 
30 information which is variable-length coded by the coding device shown in Fig. 10 is variable-length decoded. Since no 
symbol information exists in the subbands having the highest frequency (HL1 , LH1 , HH1) similarly to the description of 
the coding in this case, only the coefficient information is decoded. The set of the symbol information and the coefficient 
information which has been decoded in the set decoding portion 1101 is separated into the symbol information and 
coefficient information by the set separating portion 1 102 so that it is output to the memories 1108 and 1 109. A flow 
35 chart showing a series of these operations is shown in Fig. 13. 

[0052] As mentioned above, coded data having scalability can be decoded by another decoding device of the first 
embodiment of the present invention. 

[0053] Fig. 8 shows a second embodiment of the decoding device of the present invention. Coding device is identical 
with that of the first embodiment. 
40 [0054] The differences between the devices shown in Figs. 8 and 2 reside in that a data interpolating portion 81 0 is 
added in the device shown in Fig. 8. If the coded data which has been prepared by image coding device is not com- 
pletely input to the image decoding device or if all the coded data which has been transmitted can not decoded due to 
low processing speed of the image decoding device, the last half of the coded data may not be input to the image 
decoding device. 

45 [0055] Fig. 5 shows the contents of the memories 808 and 809 in Fig. 8 when the leading portion of the coded data 
having scalability which is input to the image decoding device. Since the coded data which has been prepared by the 
image coding device of the first embodiment has the hierarchical structure from the information of the subbands having 
lower frequency to the information of the subbands having higher frequency, the symbol information and the coefficient 
information which has been decoded from the discontinued coded data exists as represented by hatched area in a part 

so (a) of Fig. 5. 

[0056] in the part (a) of Fig. 5, blanks denote the coefficients in which the information on the coded data does not 
exist so that the information can not be decoded. The data interpolating portion 810 in Fig. 8 substitutes the coefficients 
of the blanks in the part (a) of Fig. 5 for "0" to interpolate all coefficients of the subband image. Since data on only part 
of the HL2 in the second hierarchical level of the subband exists in this case, the reproduced image area corresponding 
55 to this part has a higher resolution in a horizontal direction. 

[0057] Since all the coefficients of the subband images are collected by the data interpolating portion 810, blocking 
can be achieved as shown in a part (b) of Fig. 5 by the block forming portion 804 in Fig. 8. Alternatively, interpolation 
can be conducted for the coefficient information by the data interpolating portion 810 after the stage of the coefficient 
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decoding portion 803. 

[0058] The part (a) of Fig. 5 shows a case the coded data is discontinued in the course of the subband HL2. In the 
part (b) of Fig. 5, half-toned upper half area is an area having a relatively higher resolution in which coded data up to 
LL3, HL3, LH3, HH3 and HL2 exists in each block when blocking is conducted while lower half area is an area having 
5 a relatively lower resolution in which coded data up to LL3, HL3, LH3 and HH3 exists in each block when blocking is 
conducted. 

[0059] The subsequent operation can be proceeded as is similarly to the decoding device of the above-mentioned 
first embodiment. A reproduced image when only part of the coded data is decoded in such a manner is shown in a part 
(c) of Fig. 5. The part (c) of Fig. 5 is relevant to the part (a) of Fig. 5. Images having higher resolution can be obtained 
10 in upper half of the screen while images having a resolution which is one level lower in a vertical direction than that of 
upper half screen is obtained in the lower half of the screen. A flow chart showing a series of the operations is shown 
in Fig. 9. 

[0060] As mentioned above, the whole of the image can be decoded from part of the coded data having scalability by 
the decoding device of the second embodiment of the present invention. Coded data having a desired quantity of data 
75 can be reproduced substantially consecutively from the leading portion of the coded data when only part of the coded 
data is decoded. In other words, an image can be reproduce even if decoding is terminated in a desired position of the 
coded data. 

[0061] As mentioned above, the reproduced image of the whole image can be obtained from part of the coded data 
by providing the coded data with scalability in accordance with the present invention. 

20 

Industrial Utility 
[0062] 

25 (1) The image coding device of the present invention is capable of implementing of the scalability of the coded data, 
which has been impossible, while conducting conventional quantization in the block basis by the relocation of the 
information in the subband basis for preparing coded data after conducting subband decomposition of the image 
and performing coding process in the block basis. 

(2) Since the image coding device of the present invention can achieve quantization in the block basis to control of 
30 bit assignment for each block so that high quality of image can be achieved. 

(3) Since the coded data has scalability in accordance with the present invention, the whole of the image can be 
reproduced from part of the coded data having scalability in the image decoding device. 

(4) Since the coded data has scalability in accordance with the present invention, the quantity of data to be 
decoded can be specified to a desired number of bits in the image decoding device when only part of the coded 

35 data is decoded. 

Claims 

1 . An image coding device comprising: 

40 

a subband decomposing portion for decomposing an image into subbands to produce a first subband image; 
a block forming portion for forming a blocked second subband image by collecting subband coefficients having 
a parent-child relationship between subbands in said first subband image to form a plurality of blocks; 
a quantizing portion for quantizing said subband coefficients of each block of said second subband image; 
45 a symbol information determining portion for determining symbol information representing whether the quan- 

tized subband coefficient of said second subband image is "0" or non "0"; 

a symbol information relocating portion for relocating the symbol information of said second subband image in 
accordance with the frequency position in said first subband image; 

a symbol information coding portion for variable-length coding said relocated symbol information; 
so a coefficient relocating portion for relocating said quantized subband coefficients to be coded based upon said 

symbol information and forming a third subband image in accordance with the frequency position in said first 
subband image; 

a coefficient coding portion for variable-length coding said relocated subband coefficients; and 
a coded data integrating portion for collecting and arranging said coded symbol information and subband coef- 
55 f idents in each subband, whereby the coded data is provided with a hierarchical structure. 

2. An image decoding device for decoding coded data having a hierarchical structure, which is produced by an image 
coding device as defined in claim 1 , characterized in that said image decoding device comprises: 
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a coded data separating portion for separating said coded data into symbol information and subband coeffi- 
cients; 

a symbol information decoding portion for decoding said coded symbol information for each subband; 
a coefficient decoding portion for reproducing said third subband image by decoding each of said subband 
5 coefficient based upon said decoded symbol information; 

a block forming portion for forming said second blocked subband image comprising a plurality of blocks which 
are formed by collecting said decoded subband coefficients having a parent-child relationship in each sub- 
band; 

an inverse quantizing portion for inverse quantizing said decoded subband coefficients of said second subband 
10 image; 

a subband image producing portion for producing subband images which are relocated in accordance with the 
frequency position in said third subband coefficient by deblocking said inverse quantized subband coefficients 
of said second subband image; and 

a subband synthesizing portion for synthesizing said subband images to provide a decoded image. 

15 

3. An image coding device as defined in claim 1 , characterized in that when said coded symbol information and sub- 
band coefficients are collected into one group for each subband in said coded data integrating portion of said image 
coding device as defined in claim 1 , firstly all pieces of said symbol information in each subband are arranged and 
then all said subband coefficients in each subband are arranged. 

20 

4. An image decoding device for decoding coded data having a hierarchical structure, which is produced by an image 
coding device as defined in claim 3, characterized in that an operation for separating the coded data which is one 
group comprising the symbol information and subband coefficients which are collected for each subband into all 
pieces of said symbol information in one subband firstly, and then into all said subband coefficient information in 

25 one subband is performed for all subbands in a coded data separating portion in a coded data decoding device as 
defined in claim 2. 

5. An image coding device as defined in claim 1 , characterized in that when said coded symbol information and sub- 
band coefficients are collected into one group for each subband in said coded data integrating portion of said image 

30 coding device as defined in claim 1, sets of said symbol information and said subband coefficient corresponding 
thereto are arranged in accordance with the order of said symbol information in each subband. 

6. An image decoding device for decoding coded data having a hierarchical structure, which is produced by an image 
coding device as defined in claim 5, characterized in that an operation for separating the coded data which is one 

35 group comprising the symbol information and subband coefficients which are collected for each subband into said 
symbol information and said subband coefficient for each symbol is performed for all subbands in a coded data 
separating portion in an image decoding device as defined in claim 2. 

7. An image coding device as defined in claim 1 or 5, characterized in that in lieu of said symbol information coding 
40 portion, said coefficient coding portion and said coded data integrating portion, said image coding device com- 
prises a set forming portion for forming a set of the symbol information and subband coefficient corresponding to 
said symbol information, and a set coding portion for variable-length coding said set of said symbol information and 
subband coefficient information. 



45 8. An image decoding device for decoding coded data having a hierarchical structure, which is produced by an image 
coding device as defined in claim 7, characterized in that in lieu of a decoded data separating portion, a symbol 
information decoding portion and a coefficient decoding portion of an image decoding device as defined in claim 2 
or 6, said image decoding device comprises a set decoding portion for decoding a set of said symbol information 
and subband coefficient information and a set separating portion for separating said decoded set into symbol infor- 

50 mation and coefficient information. 



9. An image decoding device as defined in any of claims 2, 4, 6 and 8 for decoding said coded data having a hierar- 
chical structure, which is produced by an image coding device as defined in any of claims 1 , 3. 5 and 7, character- 
ized in that said image decoding device further comprises a data interpolating portion for inserting "0" into the 
55 subband coefficient value which can not be decoded if complete coded data which is produced by said image cod- 
ing device can not be inputted, whereby a reproduced image is obtained by decoding only part of coded data hav- 
ing a hierarchical structure. 
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